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THE USE OF INTEGRAL TRANSFORMS IN THE ESTIMATION 


OF TIME VARIABLE PARAMETERS 
By Henry C. Lessing and D. Francis Crane 
Ames Research Center 


SUMMARY 


A study has been made of the concept of integral transformations applied 
to the differential form of the system equations and the use of these equa- 
tions in parameter estimation. The two principal results of this study are: 
the extension of the transformation equations to explicitly account for time 
variability of the system parameters and an extension of the application of 
the concept to the output error formulation of the parameter estimation prob- 
lem. It is shown that, as a result, the output error formulation acquires 
stability properties that were impossible previously. 

Experimental results are presented to illustrate the theoretical 
developments. These results show the ability of the new formulations to 
estimate parameters that are highly variable with time. 


INTRODUCTION 


The problem considered in this report can be stated, in general, as one 
of obtaining information about a physical system from knowledge of its input 
and output. A basic assumption will be made that there is sufficient under- 
standing of the system to permit formulation of a mathematical description of 
the process involved. In a great majority of engineering situations this is a 
realistic assumption; usually enough is known about the system being investi- 
gated so that, over the range of operating conditions of interest, the numeri- 
cal values of the system parameters are the primary unknowns rather than the 
mathematical structure of the relationships among them. 

The types of parameter estimation formulation commonly called equation 
error and output error are considered in this report, with primary emphasis 
on the latter. Both formulations may utilize a predetermined mathematical 
description (system equation) as just mentioned, but their operation is funda- 
mentally different. If the system output is completely related to the input 
through the system equation, the two schemes may be defined as follows. Equa- 
tion error is formed by weighting the system variables with estimates of the 
system parameters and summing. If the parameter estimates equal the true pro- 
cess parameters, the sum will be zero; if not, the sum will equal a quantity 
called the equation error. Output error is formed by the difference between 
the output of the physical system being investigated and the output of a model 
excited by the same input and described by the same system equation but whose 
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parameters are again estimates of the true system parameters. When the 
estimated and true parameters are equal, the outputs of the system and model 
become equal, and the output error vanishes. 

A significant consideration with regard to these methods relates to the 
variables appearing in the system equation. A very large class of physical 
systems can be described with acceptable accuracy by means of ordinary differ- 
ential equations, and the great majority of parameter estimation work has been 
based on this class of system. A fundamental difficulty with this type of 
equation is that it is impossible generally to measure the derivatives of the 
system input and output appearing in it. 

One solution to this problem was developed by Meissinger (ref. 1) in the 
form of parameter influence coefficients. These influence coefficients are 
the partial derivatives of system variables with respect to system parameters, 
and thus provide the information necessary for parameter adjustment in the 
output error formulation described above. This technique has been used 
successfully in a number of applications (refs. 1 and 2). 

Another approach to the problem, the one with which this report is 
concerned, lies in transforming the system equation so that it is written in 
terms of new state variables that can be generated from those that are mea- 
surable. One of the earliest rigorous and useful transformations of this type 
to be applied to parameter estimation was developed by Shinbrot (ref. 3) . His 
transformation consisted of integrals of the product of system variables and 
appropriate "method functions." In this way, the system differential equation 
was transformed into an equation with easily obtained state variables, and 
parameter estimates were then obtained by the equation error (then called the 
equations of motion) method. 

Much later, but apparently independently, Zaborsky et al. (ref. 4) 
rederived Shinbrot' s method in connection with the identification portion of 
an adaptive flight-control system. Again, the equation error type of param- 
eter estimation was used. It is interesting that Zaborsky utilized a form of 
method function specifically excluded by Shinbrot on the basis of inaccuracy 
of the parameter estimates. Although some problems of this sort were experi- 
enced, the system apparently worked well, and the variables generated by the 
method function used were simple and required a minimum of the limited 
capacity of the on-board computer. 

These transformations may be viewed as convolutions with the impulse 
response of nonphysically realizable filters. Transformations using physi- 
cally realizable filters were developed almost simultaneously by three inde- 
pendent researchers. Valstar (ref. 5) and Rucker (ref. 6) in the United 
States, and Young (ref. 7) in England, although motivated differently and 
approaching the subject from slightly different viewpoints, arrived at essen- 
tially identical results: namely, that the system differential equation can 

be transformed into a more readily usable state variable form by passing the 
system input and output through successive physically realizable transforma- 
tion filters. Each researcher utilized his results in an equation error 
formulation of the parameter estimation problem. 
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The transformation formulations developed to date are strictly valid only 
for constant parameter systems . The present report extends the concept by 
deriving transformation equations that account for time-variant parameters. 

Another aspect of these transformations regards their interpretation. As 
noted, their developers have taken the point of view that they provide only a 
generalized equation error structure for parameter estimation. This point of 
view is also maintained in reference 8, where comparisons are made between the 
performance capabilities of equation error and output error systems, and a 
plausibility argument is given for output error systems (based essentially on 
Meissinger ? s influence coefficient approach) being stable only for suffici- 
ently low gains. Asymptotic stability is proven for the generalized equation 
error system based on the formulation of Rucker. The present report shows 
that by taking the viewpoint that the transformed system equation represents a 
generalized model structure, most of the stability properties associated with 
the equation error formulation also apply to the output error case. 

Experimental results are presented to illustrate the theory and concepts 
developed. 


NOTATION 
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parameters of the plant system equation 
system output 

equation error or output error 
c + n 

additive noise or transformation order 
performance criterion 
Laplace transformation variable 
time 

rth transformation of a quantity q (eq. (6)) 
input 

parameter rate of change in percent of mean value per second 

ith model output 

d^a n d^bjfl 


estimate of 


dt 


dt 1 
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CO 


OV 


(*),(") 


transformation filter time constant, sec 
frequency, rad/sec 

frequency of harmonic parameter variation, rad/sec 

dO d 2 ( ) 

dt ’ dt 2 

THEORETICAL DEVELOPMENT AND ANALYSIS 


Transformation of a System Equation With Variable Parameters 

Consider a system with input u and output c which can be described by 
a differential equation 



n=o m=o 


in which there are N + M + 1 independent, possibly time varying, parameters. 
Operate on equation (1) with the integral transformation 



This transformation consists of j convolutions of equation (1) with a 
transformation filter defined by an impulse response h(t) which, as indicated 
by the integration limits, is to be that of a physically realizable system. 

For the purposes of this report, we will use the simplest filter and the one 
that has been employed most frequently, namely, a first-order lag defined by 
the system function 

Htsj = ^jVr to 

or the impulse response 

h(t)=ie' t/T (4) 
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The details of carrying out the transformation (2) utilizing this 
impulse response are given in appendix A, where it is shown that the jth 

k k 

transformation of the term g^(d q/dt ) is given by 


l k = J~' c-n 1 ii l izi n T i- k iA Y " 1 r_n* 


CTi+j-k+lO + f CO 


where 


3 

0 < k ^ max [N,M] 


q = c or u 


= a or b 


and where f(t) is an exponentially decaying function of time generated by 
initial conditions of the parameters, the input u, the output c, and their 
derivatives. The symbol T r q represents the rth operation on q by the 
transformation filter described by equations (3) and (4) : 


V 5 3 




T r q - 


d5 r • • • / 3 e T dC 2 j 2 q(?!)e T dg ; 

J O Jo 


where ^> T+l = t and T Q q = q. If now the general term (5) is used in equa- 
tion (2), the result may be written, for a given order of transformation, 
j ^max[N,M], as 


i=o n=o 


A in c in 


^im^im + F(t) - 0 


where 


A-J ri — 


5 


n 


(7c) 


C . = r-ii 1 ! T i-n 

in ( iJ i! (j_i) ! 


2-! X c 

*• J l ! (n-Z ) ! i+j-n+Z 


m 

it. _ r i-|i (i + j ~1) ' T i-m ^ ' r_i •) ^ m ' t u 

Uim - ( A J i ! (j -1) ! T / , 1 } l ! (m- Z ) ! i+j-m+Z 


The choice of this value for j eliminates all derivatives of system state 
variables in equation (7). If some derivatives of system state variables are 
measurable, they may be retained by choosing an appropriately smaller value 
for j . 

Some discussion of this result is in order. By application of the 
transformation (2), with h(t) given by equation (4), to the differential form 
of the system equation (1), we have arrived at equation (7), which is an exact 
integral form of the system equation. 

The transient response of the differential form is duplicated by 
introduction of the forcing function F(t). 

The forced response of the differential form is duplicated by 
appropriately filtering the input, equation (7d) , to compensate for the filter- 
ing performed on the output, equation (7c). It will be seen in a subsequent 
example with constant parameters that the input filtering introduces zeros 
that just cancel poles introduced in the system itself so that the overall 
system function, including the input filter, matches the system function of 
the differential form. 

Parameter variability effects are duplicated through the infinite 
expansion in increasing orders of parameter derivatives in equation (7) . 

Equation (7) does not represent a unique system description: an 

arbitrarily large set of system equations of the form of equation (7) may be 
constructed simply by setting, in equation (5), j = max[N,M] + i, 
i = 0, 1, 2, . . . , by setting j = max[N,M] and using a different value of 
x for each transformed equation, or any combination of these two methods. 

Still another alternative exists without changing the form of the transforma- 
tion filter. Equation (5) was developed for the case in which all the trans- 
formation filters in a given T r q were characterized by the same time 
constant t as indicated in equation (6). Clearly, this is not a necessary 
restriction; each succeeding transformation filter could have a different 
value of t. The resulting equation corresponding to equation (5) is consider- 
ably more complex and will not be presented in this report, but there clearly 
are an infinity of ways of generating independent transformed system equations. 
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Transformation of an Example System Equation 


In this section, we will consider a simple example to illustrate the 
preceding development. Consider the system shown in sketch (a) described by a 

differential equation of first order: 

+ 


Sketch (a) a 3 c + a Q c - b Q u = 0 (8) 

Here, N = 1 and M = 0 and thus there are N + M + 1 = 2 independent param- 
eters. Without loss of generality then, one of the parameters may be set 
equal to unity, but for the present all three will be retained to illustrate 
the transformation equations. With j = N = 1 in equation (7), the first 
transformed system equation is found to be, upon multiplying through by t. 


Qi s + a 0 


ai (c 
- aiiCTxc 
+a 1 x 2 (T2C 


+F(t) = 0 




Tic) + a 0 x (Tic) 
T 2 c) - 4 0 t 2 (T 2 c) 
t 3 C) + a 0 x 3 (T 3 c) 


+ 


VCTiU) 
V 2 (T 2 u) 
b Q T 3 (T 3 u) 






(9) 


~ t / T 

where F(t) = -a 1 (0)c(0)e . This equation clearly shows some of the points 

mentioned earlier. Consider the initial condition response. As can be seen 
by definition (6) , the initial values of the transformed input and output 
variables are equal to zero (excluding impulsive-type inputs), and at time 
zero equation (9) reduces to the identity 


a x (0) c (0) - a 1 (0)c(0) = 0 

Therefore, if u = 0 for all time, then T r u = 0 for all time, and the 
initial condition response is given by the response of the remaining terms in 

equation (9) to the forcing function F(t) = a 2 (0) c (0) e~ t/T . 

To illustrate how the forced response of the integral form of the system 
equation (9) duplicates that of the differential form, equation (8), consider 
the parameters to be fixed and take the Laplace transform of equation (9) : 


x (a 2 s + a Q ) 
xs + 1 


c(s) 


b 0 x 

ts + 1 


u(s) = 0 
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b 0 r 


TS + I 



f 

TS + 1 


r(a l s +a 0 ) 







Sketch (b) 


In block diagram form (sketch (b)), it can be 
seen how the pole at s = -1/t in the input 
filter just cancels the zero in the plant 
which has been introduced by the transforma- 
tion. The overall system function thus 
remains the same as shown in sketch (a) . 


By setting j = N + 1 = 2 in equation (7) , the second transformed 
system equation is found to be 


a l ( T i c 
- ai2r(T 2 c 
+ai3x 2 (T 3 c 


T 2 c ) + a 0 T ( T 2 c ) ” b 0 r(T 2 u) 
T 3 c) - a 0 2x 2 (T 3 c) + b 0 2x 2 (T 3 u) 
T 4 c) + a 0 3x 3 (T 4 c) - b Q 3x 3 (T 4 u) 


( 10 ) 


+F(t) = 0 J 


” t / T 

where now F(t) = -a 3 (0) c(0) (t/x)e . Additional system equations can be 
generated by further transformations , or, as mentioned earlier, by the use of 
various values of x in equations (9) and (10). 


Examples of Two Parameter Estimation Formulations 


The use of the transformed type of system equation in parameter 
estimation will be examined in detail in the following sections, but some 
preliminary discussion is in order here regarding the approach that has been 
used exclusively to date, and an extension to this approach. Consider the 
equation error type of parameter estimation scheme; an example of this formu- 
lation can be illustrated by equations (8) and (9) and the block diagram of 

sketch (c) . If equation (8) defines a 
system whose parameters are to be numeri- 
cally evaluated, and the input and output 
are transformed and combined as in equa- 
tion (9) , then if the parameters appearing 
in equation (9) are inaccurate estimates 
of the true parameters, the sum will not 
equal zero as shown, but will equal a 
quantity shown in sketch (c) as E, which 
is called the equation error. The advan- 
tage of this form of the system equation 
is that the variables appearing in it are 
easily obtained by simple integral opera- 
Sketch (c) tions on the input and output, in contrast 
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to the often impossible task of obtaining the variables of the differential 
form of the system equation. This, of course, was the primary motivation for 
the original development of the concept. An additional feature has now been 
added: equation (9) explicitly includes terms that account for parameter 

variability and thus provides more accurate modeling of time-variable systems. 
Although this development has been made here only for the case of a physically 
realizable transformation filter, an equivalent development is possible for 
the nonphysically realizable transformation filters discussed in the 
Introduction. 

As mentioned in the Introduction, the originators of this type of 
transformed system equation, and those who have subsequently used this 
approach, have considered the equations only in the above context, that is, as 
a generalized structure for the equation error formulation of the parameter 
estimation problem. In the present report, we will show that another point of 
view is possible, namely, that the transformed system equations provide also a 
generalized model structure that can be used in the output error formulation 
of the parameter estimation problem. This can be illustrated by using equa- 
tions (8) and (9). Equation (9) has already been shown to define the same 
dynamic structure as equation (8). Thus, it can be considered to define a 
model of the system defined by equation (8), a separate dynamic entity which, 
if its parameters and initial conditions equal those of the system, and if it 
is forced by the same input that forces the system, will have a response iden- 
tical to that of the system. Consider the constant parameter, forced response 
case of equation (8) with ai set equal to unity. Designate the model output 
as y. Then equation (9) may be rewritten 1 as 

/ = T,y - a 00 T( Tl y) + 3 00 xCT lU ) (11) 

and used to define a model in an output error formulation as indicated in 
sketch (d) . When the model parameters a Q0 and 3 OQ are inaccurate estimates of 

a G and b Q , the model output y, and 
the system output c are not equal. 
Their difference is shown in 
sketch (d) as E, which is called 
the output error. The next section 
will show that here also, as in the 
case of the equation error formula- 
tion, there are significant advan- 
tages to using the integral form of 
the system equation rather than the 
Sketch (d) differential form. 


1 The double subscript notation introduced here for the model parameters 
will be used to designate both the appropriate system parameter and its partic- 
ular derivative to which the model parameter corresponds. For instance, a-^ n 
corresponds to d x a n /dti. 
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Parameter Adjustment 


To this point, all that has been said regarding the parameter estimates 
in either the equation error or output error formulation is that if they are 
equal to the true parameters, the resultant errors (E in sketches (c) and (d)) 
vanish. The means by which the parameter estimates are to achieve the correct 
values has not been described. 

Two basic approaches exist, each of which is uniquely suited to a 
specific type of computer. The first is matrix inversion. In the preceding 
section two independent parameters exist in the system described by equa- 
tion (8) . If the parameters are constant then equations (9) and (10) reduce 
to the time-invariant case given by the first line, and a matrix inversion 
solution yields the two values. This type of solution obviously requires a 
digital computer. 

Solution by analog computer may be obtained by gradient-type techniques. 

A nonnegative, increasing performance criterion must be selected, for instance, 

P = j E 2 (12) 

A parameter adjustment strategy that makes use of knowledge of the gradient of 
the surface formed by the performance criterion must also be chosen. One 
strategy commonly used is that of steepest descent (ref. 9), defined, for the 
case of continuous parameter adjustment, by 


Y- • (t) 

i) 


- k ij 


3P(t) 

3y. . (t) 
ij 


(13) 


where y^ represents each of the independent parameter estimates (a 
j) in turn. Consider the meaning of equation (13). The rate y 




'ij 


ij and 
at which 


the parameter estimate is varied at time t is proportional to the negative 
change of P at time t per unit change of y^ at time t. In the equa- 
tion error formulation, the instantaneous gradient component 3P(t)/3y. . (t) 

of the surface formed by the performance criterion is given directly by the 
state variable associated with the parameter being considered. This is true 
for both the differential and integral forms of the system equation. 


In contrast with the availability of exact instantaneous gradient 
information obtainable in the equation error formulation, continuous parameter 
adjustment in the output error formulation must use inexact information when 
the differential form of the system equation is used. This is due to the fact 
that the instantaneous gradient component 3P(t)/3y^_. (t) is identically equal 

to zero since the model output does not respond instantaneously to changes in 
parameter estimates. The parameter estimates must, therefore, be adjusted in 
accordance with a prediction of the future response of the model output due to 
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a change in the parameter estimate "now" at time t. This is the type of 
information provided by Meissinger's influence coefficient solutions. However, 
the underlying theory is strictly valid only for zero rate of adjustment of 
the parameter estimates (ref . 2) , and the accuracy of the information degener- 
ates as the adjustment rate increases. This limits the use of techniques 
based on Meissinger’s influence coefficients to parameter estimation of 
stationary or very slowly varying systems. 

Use of a model defined by the integral form of the system equation 
eliminates this difficulty entirely; the model output now responds instanta- 
neously to changes in the parameter estimates, the instantaneous gradient com- 
ponents are again nonzero, and their values are obtained in the same 
straightforward manner as for the equation error formulation* 


Stability 

Many proofs can be found in the literature that the equation error 
formulation of the parameter estimation problem is stable (see, e.g., ref. 8). 
The proofs remain valid when the parameter variability effects are explicitly 
included in the transformed system equation. No such proofs can be found for 
the output error formulations that utilize continuous parameter adjustment. 

To date, only the differential form of the system equation has been used, and 
gradient information has been obtained from methods essentially the same as 
that of Meissinger (refs. 8 and 10). Although successful convergence of the 
parameter estimates has been achieved with appropriate^choices for the param- 
eter adjustment rate gains (k^j in eq. (13)), experience seems to indicate 
such formulations can always be made unstable by choosing sufficiently large 
gain values (refs. 2 and 8). The stability of the output error formulation, 
when a model defined by the integral form of the system equation is used, will 
be examined in this section. 


Consider a system defined by the differential equation (1). Initial 
conditions have no place in the following discussion, so they may be assumed 
to equal zero. Then the system is also defined by equation (7) with F(t) * 0. 
Construct a model of the system 


N M 


im^im 


1=0 


n=o 


m=o 


0 


(14) 


and normalize the system equation (7) by the n = N zeroth derivative param- 
eter. Normalize equation (14) by the corresponding parameter estimate. Then 


a 0N " a 0N = 1 


(IS) 


It immediately follows that A iN = ct-j^ = 0 for i > 0. If we use the 
performance criterion (12), and define the error in a manner similar to 
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sketch (d) , then 2 


E " y ON “ C 0N 


( 16 ) 


Adjusting the model parameter estimates according to equation (13) gives 

“in = + ^in E ^in » n f N 
= _k im EU im 

Now the performance criterion will vary with time according to 


(17) 


P = EE 


= E 


1=0 


N-l 


M 


— Y- ou,, + 
m in 


u im e im 


n=o 


m=o 


+ E 


(n) , 

' 'a, I 


( 18 ) 


Substituting equation (17) in (18) gives 


P = -E" 


CO 

L 

i=o 


N-l 

L 

n=o 


M 


Win * 


k im u L 


m=o 


+ E 


(—) 

V 9t / i 
' 7 a, I 


(19) 


The last term in equation (19) is a function of system and model input, param- 
eter estimate inaccuracies, and system parameter variability. The first 
(bracketed) term is due to adjustment of the parameter estimates in the model. 
Thus, the effect of adjusting the parameter estimates according to equa- 
tion (17) is to drive the performance criterion toward zero, and a zero value 
will be assured if 


1=0 


N-l M 

n=o m=o 


k • U? 
K im u im 



( 20 ) 


a condition which can be realized with sufficiently large .adjustment gains. 

Satisfaction of inequality (20) guarantees convergence of the performance 
criterion to zero; it does not, however, guarantee that the parameters will 

2 Sketch (d) defines E = y - c. In terms of the specific example 
considered previously, equations (9) and (11), the definition (16) gives 
E = (y - T x y) - (c - T 2 c). This definition simplifies the succeeding equa- 
tions, and has no effect on the arguments presented, which apply equally well 
to the definition of sketch (d) . 
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converge to a unique set. It is obvious from equation (14), the model system 
equation, that at any instant of time there are an infinity of combinations of 
parameter estimates which will satisfy P = 0. This result has been 
thoroughly discussed in the literature (refs. 2 and 8), and is due to the fact 
that the performance criterion, equation (12), does not represent a surface 
with closed contours of constant P. The analogous digital solution diffi- 
culty is a singular matrix resulting from more unknowns than equations. 

Unlike the digital case, however, convergence to a unique solution is still 
possible in the analog gradient technique case if the adjustment gains for 
the parameter estimates are sufficiently small (refs. 2 and 8). 

Uniqueness can be guaranteed by generating a set of models, by one or 
more of the means previously described, equal to or greater in number than the 
parameters to be evaluated. An error vector can then be defined with 
components 


^r ~ ^oNr ~ ^oNr ’ r-1,2, ...,R 


and used in a performance criterion 


( 21 ) 


r= i 


Parameter estimate adjustment now proceeds as 

R 




“in = k in 


in ^t^inr ’ n ^ N 


r=i 


e im 


K 

/. Mimr 


r=i 


j 


( 22 ) 


(23) 


The variation with time of the performance criterion (22) for this case is 




co N-l 


R 


p = - 7, v] kin YL E 

i=o n=o r=l 


Y- 

r x mr 


m r R H R 

22 k i" 22 ErUimr r £ Er (h*). 

m=o r=l r=l 


(24) 
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and again it can be seen that minimization of the performance criterion is 
assured with sufficiently large gain values. Now, however, since the perfor- 
mance criterion is formed using independent models that, in number, are equal 
to or greater than the number of parameters, the set of parameter estimates 
which minimizes P is unique. 

Thus, stability of the output error formulation is assured when models 
defined by the integral form of the system equation are used, and uniqueness 
of the parameter estimates can be assured by utilizing a sufficient number of 
models. The reader familiar with the equation error formulation will recog- 
nize the direct parallel of these results to that case, but will note also a 
significant difference. Whereas, in the equation error formulation, minimiza- 
tion of the performance criterion combined with uniqueness of the parameter 
estimates means that the parameter estimates have achieved the values of the 
system parameters, this is not necessarily true for the output error formula- 
tion. Satisfaction of the two conditions guarantees that the parameter esti- 
mates will ultimately converge to the correct values, but instead of 
achieving the correct values coincident with minimization of the performance 
criterion as in the equation error formulation, the analysis in the next 
section will show the correct values will be achieved some time after 
minimization has occurred. 


Convergence of the Parameter Estimates - Output Error Formulation 

In this section, convergence of the parameter estimates will be analyzed 
for a particular example. The example will also serve to illustrate the 
structure of the output error formulation when a vector error is used. The 
first-order system defined by equation (8) will again be used. Equation (9) 
is an integral form of the system equation, the form that will be used to 
define the models. Assume the two independent unknown parameters as a Q and 
b D . The parameter ai may be set equal to unity and, of course, all its 
derivatives equal to zero. For simplicity, and with no loss of generality as 
regards time for parameter convergence, assume also that b Q is time 
invariant. 

Assume zero initial conditions. Then equation (9) may be written 

c - Tjc + a 0 xTiC - a 0 x 2 T 2 c + a 0 x 3 T 3 C - ... - b^^u = 0 (25) 

The number of unknown parameters in this equation is determined by the number 
of derivatives of a Q necessary to adequately approximate its variability. 

If the vector error, equation (21), is used to ensure parameter estimate 
uniqueness, then the minimum necessary number of error components (and, there- 
fore, system models) is determined by the number of unknown parameters in 
equation (25) . Each model must be defined by an equation that corresponds 
to an independent system equation, formed by one or more of the methods 
described previously. If, in the present example, these equations are formed 
by setting j = 1,2,3, ... in equation (5), then equations (9), (10), and 
subsequent transformed system equations result. With the conditions that 
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enable equation (9) to be written as equation (25), equation (10) may be 
written as 


T x c - T 2 c + a 0 xT 2 c - a 0 2x 2 T 3 c + a Q 3x 3 T 4 c - ... - b Q xT 2 u = 0 (26) 



Sketch (e) 


and so on for the higher trans- 

formations. The output of the 

system defined by equation (25) 
is c, that of the system defined 
by equation (26) is Tic, that 
defined by the higher transforma- 
tions, T 2 c, T 3 c, etc. With a 
model defined to correspond to 
each of these variables, the 
structure of the output error 
£3 formulation appears as shown in 

sketch (e), where TF denotes 

x the transformation filter defined 

by equation (3) or (4) . 

The first model, whose 
output is to correspond to equa- 
tion (25), is defined by 


y x - T iyi + «oo TT iyi ~ a io x2T 2 yi + « 2 o T3T 3 y 1 - ... - e (X > TT 1 u = o (27) 
The second model is defined by 

y 2 - T iy2 + a oo TT iy2 ~ a io 2x2T 2 y2 + a 2o 3x3T 3y2 - • • • - iw t 2 u = 0 c 28 ) 


and, similarly, for the models corresponding to the higher transformations. 
In general, the model equations can be written 


y = P, „ 
7 r lr 


T ]/r + P 2r T 2 y r 


+ P 


3r T 3^r 


+ Q r T r u 


(29) 




I 

i 

Sketch (f) 


where the F l and Q r contain the 
- parameter estimates appropri- 
ately weighted for each model. 

The important point here 
is the model structure implied 
by equation (29) , shown in 
sketch (f) . Consider that the 
system and model variables have 
all reached their steady-state 
condition (i.e., that all tran- 
sients have disappeared) and 
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that the parameter estimates are set at some incorrect value. Then the error 
vector has a nonzero value. If now the parameter estimates are adjusted in 
accord with equations (23), and if the adjustment gains are sufficiently large, 
the error vector can be driven quickly to the vicinity of zero and constrained 
to remain there. As discussed previously, although the set of parameter esti- 
mates that initially forces the errors to the vicinity of zero are unique, 
they cannot equal the true parameters. This is because the model structure of 
sketch (f) defines also the system structure, and the parameter estimates can- 
not equal the true parameters until the corresponding variables in model and 
system are equal. This is, in model 1, T 1 y 1 , T 2 Y\, • • • must equal 
Tic, T 2 c, . . . ; in model 2, T x y 2 , T 2 y 2 , . . . must equal T 2 c, T 3 c, . . 
and so on. In general T n y r must equal the system variable T n+r _ic in 
order that the parameter estimates equal the true parameter values. The time 
it takes T n y r to equal Tn+r-i c > if E r is forced instantaneously to zero, 
can be estimated from the propagation time of a step input through the series 
of transformation filters in a model as shown in sketch (f) . The percent 
error between the two variables is given by 


e n = 100 


T n+r-i c ~ T nyr 

T c " 
A n+r-i u 


= 100 


i t 1 ft j 
1 + “ + T ~ I + 
t 2 It 


(n - 1)! 


n-i 


-t/T 


(30) 


100 


and is shown in sketch (g) . 

From this relationship, the time 
for effective parameter conver- 
gence can be estimated from the 
time for the difference between 
the highest order transformation 
variables to effectively dis- 
appear. Figure 1 gives the time 
for the error to drop to a value 
of 1 percent. 

This is a general result 
since sketch (f) , to the right 
of the summer symbol, is a gen- 
eral picture of model structure, 
the number of transformations 
depending on the number of sys- 
tem poles and the variability of 
the a n parameters. The number 
of input transformations to the left of the summer symbol is determined by the 
variability of the b m parameters and by the number of system zeros, but 
there is no effect on the length of time for parameter convergence since the 
input transformations are not affected by changes in the parameter estimates. 



Sketch (g) 
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Although finite parameter adjustment gains prevent the error vector from 
being driven to zero instantaneously as was assumed here, it will be seen 
subsequently in the experimental results that the parameter convergence times 
can be estimated with fair accuracy using figure 1. 


Estimation of Nonlinear Parameters 

In the preceding sections, the parameters of the system equation have 
been considered to be time variable and, at least implicitly, independent of 
the system variables. This viewpoint is not necessary. For instance, in the 
first-order system example considered in the foregoing section, the parameter 
a Q could be considered to be a time -invariant nonlinear function of the sys- 
tem output c. It immediately follows that it is then expressible as a time- 
varying quantity, and can be estimated by the means just discussed. Recovery 
of the nonlinear function would then be achieved from a plot of the parameter 
estimate a OQ versus the system output. 

Another approach that can be used with the present transformation 
equations is due to Shinbrot (ref. 3). For example, if equation (8) is 
written as 


c + a Q (c)c - b Q u = 0 (31) 

the parameter a Q (c) is expressed as a polynomial 

a Q (c) = k Q + kxc + k 2 c 2 + . . . (32) 

of the complexity felt to be required for adequate approximation. Substitut- 
ing equation (32) in (31) and applying the transformation equations gives, for 
the first transformation, 

c - T x c + k Q xT ic + kixTifc 2 ) + k 2 xT x (c 3 ) + . . . - b Q TT 1 u = 0 (33) 

and so on as before for the following transformations. Parameter estimation 
proceeds exactly as for the linear case. 

There are no conceptual difficulties in generalizing further to systems 
with time-varying nonlinear parameters. The coefficients in the polynomial 
(32) are then functions of time, and are handled in the manner already 
illustrated. 


PRACTICAL CONSIDERATIONS 

As a result of the development and analyses of the preceding sections, 
it is possible to draw certain inferences regarding the practical use of the 
transformed system equations in the parameter estimation problem. 


I 
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Transformation Filter Time Constant 


The transformation filter time constant, x, is fundamental to all the 
results developed in the preceding sections, and thus, perhaps not 
unexpectedly, satisfaction of various criteria can put conflicting require- 
ments on the numerical value to be chosen. For instance, rapid convergence of 
the parameter estimates to the true parameter values is a very desirable fea- 
ture. The foregoing section has shown that, in the output error formulation, 
convergence time is directly expressible in terms of x, and thus t should 
be as small as possible. 


A somewhat parallel consideration relates to parameter variability. If 
all orders of derivatives are generated by the parameter variability, then 
obviously the integral form of the system equation must be truncated, with a 
resulting loss of accuracy in the system description. It can be seen (e.g., 
eq. (9)) that the accuracy loss can be reduced by choosing a small value for 
x, thus reducing the effects of the neglected higher order parameter 
derivatives . 


In direct conflict with these requirements are the requirements arising 
from use of equation (21) . Definition of an error vector requires models 
defined by independent equations, such as equation (27) and following, whose 
outputs correspond to variables generated by independent system equations such 
as equation (25) and following. The key word here is independent. As t 
approaches zero, equation (25) approaches Tic = c, equation (26) approaches 
T 2 c = Tjc, etc. That is, the system equations are no longer independent. 

This is a result of the nature of the impulse response of the transformation 
filter, equation (4), as x approaches zero. Regardless of the value of x, 
the integral of equation (4) over all positive time is unity sec -1 , and hence 
equation (4), as x 0, is a valid definition of a unit impulse. Due to its 
sifting property, convolution of the unit impulse with a function simply 
yields the function (ref. 11). In terms of the transformation filter fre- 
quency response implied by the system function, equation (3), and as shown in 

sketch (h) , a value of x 
approaching zero implies a cut- 
off frequency approaching 
infinity and a phase shift 
approaching zero. 




Thus, x cannot be allowed 
to become too small or the 
information generated by sequen- 
tial transformations will be so 
small as to be lost in the 
noise level inherent in any 
computer, and accurate param- 
eter estimation will be impos- 
sible. Sketch (h) indicates 
that maximum independence of 
the system equations will occur 
with a small value of 1/x 
relative to the maximum fre- 
quency of the input, since each 
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transformation will then yield a large phase shift when viewed in terms of the 
frequency domain. However, a small value of 1 /t relative to maximum input 
frequency means that considerable attenuation accompanies each operation by a 
transformation filter, and again accurate parameter estimation becomes 
difficult because of the resulting low signal levels. 

Thus, the value of t should be chosen as small as possible for fast 
parameter convergence, for estimation of variable parameters and to prevent 
loss of accuracy through excessive signal attenuation, but large enough to 
ensure independence of the transformed system equations. It is clear that the 
range of values of t satisfying these requirements shrinks as the number of 
transformations required increases, and thus there is some definite practical 
upper limit to the complexity of the system to be investigated and to the 
complexity of the estimation formulation for which accurate parameter 
estimation is possible. 


Simplification of Output Error Formulation 

The number of transformation filters it is necessary to mechanize in the 
output error formulation can be reduced in the following way. It was shown in 
the section on parameter convergence time that, after convergence, the rela- 
tionship between the model and system variables is T n y r = T n+r-1 c. This 
means that, after convergence, the relationships among the model variables are 
T n y r = T n _^y r+i , i = 1,2, . . n. If this relationship among model variables 
is preserved for all time, then, for instance, equation (27) may be written 

yi - y 2 + <*00^2 " a io T2 y 3 + a 2o T3 >\ - • • • - e 0 o T ( T i u ) = o 

Equation (28) becomes 

y 2 - y 3 + <wy 3 - aio 2 -r 2 y 4 + a 2 o ^ 3 y 5 - ... - p 00 t(t 2 u) = o 

and so on. The last model must still be formed in the original way as given 
by equation (29). Thus, the transformation filters in the feedback of all but 
the last model may be eliminated. The only effect of this formulation is the 
elimination of the independent transients the models previously were capable 
of exhibiting. The only transient now existing is due to the last model; 
convergence time is unaffected, however, since convergence times for all 
models were equal. 


EXPERIMENTAL RESULTS 


First-Order System 

Experimental results for the first-order system used to illustrate the 
discussion of the previous section will now be presented. The system is 
defined by equation (8) , and the two independent parameters were taken to be 
a Q and b 0 . The output error formulation utilizing a three component vector 
error was used as indicated in sketch (e) . Mechanization was by analog 
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computer, based on equations (22) and (23). 

Yi = T iyi - a oo TT iyi 

y 2 = T iy2 - a 00 TT iy 2 
y 3 = Vs - a oo TT iy3 


The model equations used were 


+ e oo TT lU 
+ S 0 o tT 2 u ' 
+ <W T 3 U 


( 34 ) 


The value of t chosen was 0.1 second. This choice was made as small as 
possible on the basis of the preceding discussions. The input chosen was the 
sum of sine waves in all cases, three for the analog results to be presented 
and eight for the digital results. This type of input is simple to generate, 
it provides the capability for repeatable results, and it is easily made to 
satisfy the two principal requirements of sufficient information content and 
adequate system excitation. A discussion of input requirements may be found 
in references 2, 4, and 8. 

These models and those used in subsequent examples of the output error 
formulation do not contain the terms corresponding to parameter derivatives 
which have been included in the previous theoretical developments because it 
was found that inclusion of these terms caused a loss of accuracy believed to 
be due to numerical difficulties associated with the added complexity. Inclu- 
sion of the parameter derivative terms in a digital mechanization of a subse- 
quent example of the equation error formulation will be seen to provide more 
accurate estimates. 

Time-variab le para meter e stimatio n.- Figure 2(a) shows the response of 
the parameter estimates to step changes of two different magnitudes in the sys- 
tem parameters. Convergence of the parameter estimates to the true values is 
rapid, of the order of 1 second. This value of convergence time may be 
checked against the value estimated using figure 1. The highest transforma- 
tion appearing in a model feedback loop, from equations (34), is first order, 
and from figure 1, the convergence time is estimated to be approximately five 
transformation filter time constants, or 0.5 second. It will be recalled that 
this estimate is based on instantaneous reduction of the error vector to zero. 
The characteristics of the error traces in figure 2(a) indicate that the data 
were obtained with a rather low value of adjustment rate gain for the param- 
eter estimates, and that the resulting adjustment rates were the limiting 
factor in the time for convergence of the parameter estimates. 

Figure 2(b) shows the estimation of system parameters which are varying 
in a ramp fashion at rates of change Vp = 5, 20, and 40 percent of the mean 
value per second. For this type of variation, of course, only the first 
parameter derivative has a nonzero value except at those unique instants of 
time of transition when all derivatives exist as successively higher order 
impulses. Since the model structure contains no variables to account for sys- 
tem parameter variability, one would expect the parameter estimates to be less 
accurate in the vicinity of the transition points. This is borne out in fig- 
ure 2(b) for Vp = 40 percent of the nominal value per second; in the vicinity 

of the first transition point, errors relative to the nominal value of 
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approximately 9 percent in a OQ and 18 percent in B 00 occur. At the lower 
variability rates, the effect of the transition points is scarcely evident, 
and the general error level is quite low. 

When the system parameters vary in a sinusoidal fashion, figure 2(c), all 
parameter derivatives exist and, for a parameter variation frequency of 
a) = 1 rad/sec, the maximum values of all derivatives are equal. With a trans- 
formation filter time constant equal to 0.1, however, equation (25) shows that 
the effect of each succeeding parameter derivative on the output is reduced 
approximately an order of magnitude. Figure 2(c) shows the result: accurate 

parameter estimation at ojp = 0.25 and 0.5, and maximum errors of approxi- 
mately 10 percent of the nominal value for a G0 and 15 percent for B 0 o at 

03p = 1 . 


Second-Order System 

We present here results for a system with twice the complexity of the 
foregoing, a second-order system with one zero, defined by 


c + a x c + a Q c 


b-iu + b n u 


(35) 


This example will also be used to illustrate the effect of additive noise on 
parameter estimation, a topic which has not been mentioned to this point. The 
nomenclature to be used is illustrated in sketch (i) , where the variable n, 

the noise, is added to the system output c 
defined by equation (35) to form the quantity m. 

It is assumed that only u and m are measurable, 
and thus the transformed system equations are 
given by 


SYSTEM 




Sketch (i) 


T i-l m " 2T i m + T i+i m + a l T CT-^m - T i+1 m) + a 0 x 2 ( T i+ i m) 

- bi-TC^u - T i+1 u) - b 0 x 2 (T i + 1 u) = 0 (36) 


where i = 1, 2, 3, and 4. 

The first parameter estimates to be presented were again obtained by 
analog computer mechanization of the steepest descent solutions of the output 
error formulation. Four models were used, corresponding to equation (36), 

y± = 2T 1 y i - Vi - aoi-rCVi - VP - a 00 T 2 (T 2 yi) 


+ $oit (T^u - Ti +1 u) + (3 qqT 2 (Ti + ^u) 


(37) 


where i = 1, 2 , 3, and 4. 
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These models were used to form a four- component error vector (sketch (e)), 
except that the system variables were considered to be T r m rather than T r c. 
It should be noted that if n is simply a constant (bias), its effects can be 
eliminated by inclusion of another model or, perhaps more straightforwardly, 
by passing both u and m through identical high-pass filters before parameter 
estimation is attempted. Results will be presented first for n = 0. 

Time-variable parameter estimation.- Experimental results for the system 
parameters, again performing step, ramp, and harmonic variations, are pre- 
sented in figure 3, where now the true and estimated parameters are super- 
imposed in the lower part of the figure. Figure 3(a) shows the response of 
the parameter estimates to step changes in the system parameters of three 
different magnitudes. The highest transformation in the feedback loop of each 
model, from equation (37), was second order. The transformation filter time 
constant was again set at 0.1, thus leading to an estimated convergence time 
from figure 1 of approximately 0.7 second. Figure 3(a) shows that, as the 
starting transient disappears, parameter estimate convergence time approaches 
this estimated value, and that convergence time is independent of parameter 
step size. 

Figure 3(b) shows that the parameter estimates were able to follow ramp 
changes of the system parameters with an accuracy somewhat less than that for 
the first-order system, but which was nevertheless quite good. The primary 
error appears as an almost constant lag of the estimates behind the true 
parameters. Again, the effects of the higher parameter derivatives at the 
transition points are discernible only at the highest rate shown. 

The results for the harmonic parameter variation presented in figure 3(c) 
also show some reduced accuracy relative to the first-order system. In this 
figure, it can be seen that the primary cause of inaccuracy was a slight phase 
shift between the true and estimated parameters; maximum excursion amplitudes 
were estimated fairly accurately. Even at a)p = 2 rad/sec, where periodically 

the error reached values exceeding 50 percent of nominal for g 00 , it can be 
seen that a fairly accurate overall picture of parameter variability is 
obtained. 

Error vector components .- As discussed earlier, parameter estimate 
uniqueness can be guaranteed only if the number of components in the error 
vector is equal to or greater than the number of parameters. It was also 
mentioned that, with fewer error components than parameters, parameter esti- 
mate uniqueness was still possible in the analog gradient solution case if the 
adjustment gains on the parameter estimates are sufficiently small. 

These remarks obviously refer to the time-invariant case. The question 
then arises: To what extent is it possible to estimate time-variable param- 

eters with fewer error components than parameters? Figure 4 is a partial 
answer to this question for the second-order system. As shown in the center 
of the figure, the number of error components was varied from four to one. 

The parameter estimate adjustment gain was maintained at the same value used 
to obtain the results of figure 3. It can be seen that, for this level of 
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gain, a slight deterioration in accuracy occurred as the number of error 
components was reduced to three and then to two. The scalar error case is 
completely unacceptable, however, with 6 q 0 approximately 180° out of phase 
with b Q , and extreme errors in each of the other parameter estimates also. 
These results show that the estimation of parameters with a rather high degree 
of variability does not necessarily require a complete error vector. 

Interaction of parameter est imates . - In all the preceding results, each 
of the system parameters was varying in the same manner - step, ramp, or 
sinusoid. It is therefore not apparent from these results to what extent 
variation of one parameter affects the estimation of another parameter. 

If the system variability could be modeled exactly, and if the adjustment 
gain could be made sufficiently large that the error vector could be con- 
strained to zero, no interaction between parameter estimates would be expected. 
The results presented so far show that sufficient gain to maintain the error 
vector in the close proximity of zero can indeed be achieved. System vari- 
ability is not modeled by equations (37), however, and so inaccuracies in the 
estimate of a varying parameter must necessarily exist, with consequent 
inaccuracies in the other estimates also. 

Figure 5 shows the magnitude of this effect in the second-order system, 
again for a sinusoidal variation with a)p = 1 rad/sec. The number of varying 

system parameters is clearly evident from the lower part of the figure, rang- 
ing from all four, which is a repeat of previous data, to a single varying 
parameter, b^. The results show that the error in each parameter estimate is 
roughly independent of the number of system parameters which are varying; that 
is, in this case at least, the inaccuracy in a parameter estimate does not 
increase as the number of varying system parameters increases. This may not 
be a general result, but it is an encouraging one. 

Adjustment gain .- Accurate estimation of variable parameters is obviously 
impossible if the maximum adjustment rate of the estimates is less than the 
maximum rate of parameter change. This determines the lower gain limit. An 
approach to the lower gain limit has already been indicated in the first-order 
system results shown in figure 2(a), where the gain was sufficiently low that 
the error components were allowed to achieve rather large values. Neverthe- 
less, accurate estimation of the variable parameters was possible in 
figures 2(b) and 2(c). 

The upper gain limit is somewhat less well defined than the lower limit. 

It was discussed previously how output error formulations that utilize the 
differential form of the system equation can always be made unstable by choos- 
ing sufficiently large parameter adjustment gains. It was also shown that use 
of the integral form of the system equation eliminated this type of problem. 
Even with this constraint on the adjustment gain removed, it will be seen that 
there is some maximum value of gain for the best estimation of time-varying 
parameters. This is indicated in figure 6 where results for the Wp = 1 rad/sec 

sinusoidal variation are shown for three values of gain: the nominal value 
used to obtain all the previous second-order results, twice the nominal, and 
ten times the nominal. (The second component E 2 inadvertently was not 
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recorded for the nominal case, but it actually was an active component of the 
error vector.) The results for the nominal and twice nominal gain values are 
not significantly different. The ten times nominal results show a greatly 
increased variance about the true parameter values, however, and thus this 
gain value may be considered too great. 

Two effects are present which together determine the upper gain limit. 

The first is the noise level of the computer; increased gain causes the param- 
eter estimates to respond to erroneous signals that are not directly related 
to the estimation problem. The second effect is caused by the inexact model- 
ing of the system variability. To illustrate this, consider again the first- 
order system of equation (8) . Let a 0 be the single variable parameter and 
b 0 equal unity. The system is thus described by 

c + a D c = u 

Equation (A4) can be used to write an exact integral form as 

c - T}C + a 0 xTiC - x 2 Tj(a 0 T 1 c) - xT^u = 0 (38) 

For this very simple case, the output error formulation requires but a single 
model. This is defined by 


y i - T i> r i + wVi - tT i u = 0 (39) 

Now if a matrix inversion technique is used, or if a gradient technique is 
used with the adjustment gain sufficiently large, then the single required 
error 


E = y x - c (40) 

can be held to zero. The model variables will then become equal to the 
system variables, and equation (39) can be written 

c - T^c + cIqqXTjC - xTjU = 0 (41) 

The value of a OQ that holds E equal to zero can thus be determined from 
equation (41) . It can be expressed in terms of the true parameter a Q by 
subtracting equation (38) from (41) and solving to give 


Ti(a 0 T lC ) 

“oo a 0 " T T]~c 


(42) 


Now the zero crossings of T 1 (a 0 T 1 c) and TjC obviously do not occur at the 
same instants of time, and thus the parameter estimate a OQ will have an 
infinite variation about the true (variable) value a Q . 

The result is a consequence of infinite adjustment gain. For physically 
realizable gain values, the error is not held identically to zero, and the 
parameter estimate variability is filtered by the single integration in the 
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adjustment loop to give the resultant variability evidenced by all the 
estimates that have been presented. As the gain level is increased as in 
figure 6, the error components are constrained closer to zero, with the result- 
ing increase in variance shown. There is thus no clear-cut upper gain limit, 
but best results will obviously be obtained by making the gain only suffi- 
ciently large to encompass the bandwidth of the variable parameters. 

Equat ion error f ormu lation .- We present in this section parameter 
estimates for the second-order system obtained by digital matrix inversion 
solution of the equation error formulation. The transformed system equations 
expressed as components in the vector equation error are given by (if all 
parameter derivatives higher than the first are assumed to be zero) . 

Ei = T-j^m - 2Tim + T^ +1 m 

+ a ol T ( T i m-T i +1 m ) + “oo 1 - 2 ( T i+l m ) - eol'r(T i u-T i+i u) - e 0 o T2 ( T i+i u ) 

-2anT 2 (T i+1 m-T i + 2 m) - 2a lD T 3 (T i+2 m) + 2Bj x t 2 (T i+] u-T i+2 u) + 20 1 o t 3 (T i+2 u) 

(43) 

Two sets of results will be presented, one set for which the parameter 
derivative terms were assumed zero, and for which i = 1, 2, 3, 4, and another 
for which the full equation (43) was used, with i= 1, 2, . . .,8. 

These results are shown in figure 7 for a ramp variation of the system 
parameters . Large variations of the estimates about the true value of the 
parameters occur when the system parameters are assumed to be invariant. 
Addition of the parameter derivative estimates greatly improves the accuracy 
of the solution because of the more accurate modeling of the variable system 
dynamics. Maximum errors occur near the transition points where all orders of 
parameter derivatives exist. 

The analog results presented previously (fig. 3(b), Vp = 40) contained 
the assumption of constant system parameters, yet did not exhibit the extreme 
variability shown by the analogous digital results. This is because of the 
smoothing action of the steepest descent type of solution at the gain levels 
used. As discussed in the foregoing section, increasing the adjustment gain 
tends to make the analog results increase in variability about the true value. 

It will be noted that the roughly constant lag exhibited by the analog 
estimates of figure 3(b) has been eliminated by including the parameter deriva- 
tive estimates in the digital solution. The fact that the parameter estimates 
in the digital solution are not exact during the ramp variation is due to 
computation inaccuracies introduced by a relatively large integration step 
size. 


Noise . - The effects of additive noise on the accuracy of parameter 
estimation is shown in figure 8, where the noise-to-output-signal ratio (rms) , 
n/c, is varied from 7 to 28 percent. Parameter estimate response with no 
additive noise is also presented for comparison. The noise was wideband - 
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essentially white over the frequency range of interest - filtered by a first- 
order low-pass filter with a breakpoint at 10 rad/sec. The sample statistics 
for a period of 100 seconds were as shown in the following table. The bias 
for all parameter estimates over the same sample period was less than 

3.5 percent of their nominal values. 

The unbiased nature of the parameter 
estimates is due to the fact that the 
models operate only on the input, which 
is uncorrelated with the noise (ref. 12). 


n/c, 

percent 

Standard deviati 
in percent of 
nominal value 

a oo 

a oi 

^oo 

7 

6.3 

3.3 

8.7 

14 

12.7 

6.7 

16.8 

28 

22.6 

13.6 

32.4 


$0 1 

4.1 

8.0 

15.2 


Even though unbiased, the variance 
exhibited by the parameter estimates at 
the higher noise-to-signal ratios would 
make it extremely difficult, if not 
impossible, to determine the details of 
parameter variability if both noise and 
variability existed simultaneously. 


Additive noise actually exists in the form of measurement inaccuracies in 
every experimental situation. The noise level from this source would normally 
be much lower than the maximum level shown in figure 8, but should it be of an 
unacceptably high level for any reason, some improvement in parameter estimate 
variance could be obtained by changing the makeup of the error vector. Refer- 
ring to sketch (e), the error components would be changed to (with m 
replacing c) 

_ y± ^i-i 111 

where i = 2, 3, . . . . The amount of improvement is dependent on the 
characteristics of the noise, increasing with increasing noise bandwidth with 
constant rms . 


CONCLUDING REMARKS 


This report has considered the concept of applying integral transforma- 
tions to the differential form of the system equation. This is a well-known 
concept that has received considerable attention as applied to parameter 
estimation because it transforms the system equation to a much more usable 
state variable form. 

Two new developments have resulted from this study. The first is the 
extension of the concept to explicitly account for time-variable parameters. 
The second is the recognition of the viewpoint that, in addition to the tradi- 
tional concept of providing a generalized structure for an equation error 
formulation of the parameter estimation problem, the transformed equations can 
also represent a generalized model structure for the output error formulation. 
This concept provides the output error formulation with stability properties 
which were not achievable in previous formulations. 
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The experimental results presented showed the ability of the new 
formulations to estimate parameters that are highly variable with time. They 
also show that extending the integral transformation concept to the output 
error formulation enables the use of this concept to obtain parameter esti- 
mates that are unbiased in the presence of noise introduced in the output. 


Ames Research Center 

National Aeronautics and Space Administration 
Moffett Field, Calif., 94035, Jan. 6, 1969 
125-19-01-16-00-21 
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APPENDIX A 


DETAILS OF APPLYING THE INTEGRAL TRANSFORMATION 


In this appendix, the essential details of carrying out the transforma- 
tion equation (2) of the text will be illustrated. The transformation is 
carried out term by term on the sums of differentials enclosed by brackets. 

The first transformation of the zeroth derivative term is 

, rt it 

1 1 = i g (OqCOe T d6 (Al) 

J Q 


where 


q = c or u 
g = a or b 

and where the notation I. indicates the jth transformation of the kth 

J 

derivative term. If equation (Al) is integrated by parts, the result is 


r t d rt Zj-t 

■i = g 0 Ct)T iq - 7 I dT d5 J ^ 5 i )e T d5 i 


(A2) 


where T r q is defined by 


t ^r~ t 




/• L 1 




dC 


r • 




5 2 


q(Sl)e (A3) 


Substituting the identity 


t = 5 + (t - 5) 


in the exponent of equation (A2) gives 


1 ? = g 0 (t)T iq - £ 


, 5-t 

dg o ~ 

dT e dc 




q(5i)e 1 d5 x 
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which, in the notation of equation (A3), can be written 

I? = g o (t)T iq - xTiCg^q) 
Upon integrating again, the result is 


dg l 

I?=g (t)(T iq ) - t ^ (T 2 q) + i 


J e T d i 2 j 


Ci c 2 


d? 2 | q(5i)e T 
o 


Continuing this process then gives, in general. 


d 8r 


d 2 g r 


I? = g o (t)(T iq ) - x ^ (T 2 q) + t 2 (T 3 q) - . . . 


The second transformation of the zeroth derivative term indicated in 

equation (2) is r 

C t 

T 0 1 T 0 T 

h = ~ \ h e d? 


By proceeding as before, the result is found to be 


dg. 


d 2 g r 


12 = g 0 Ct)(T 2 q) - 2x ^ (T 3 q) + 3x" — ^ (T^q) 


dt" 


and the general transformation of the zeroth derivative term is given by 


oo j. 

i° = y f-n 1 ci + 3 " i)! x 1 d g . ° (t- . 
j Z-j C J dt i L 1+ J 

i=o 


q) 


The next transformation in equation (2) to be considered is that of 
first derivative term: 


1 T 


(■■ 


C-t 

CO gf e T d£ 


Integrating by parts gives 


(A4) 

dSi 

(A5) 

(A6) 

(A7) 

(A8) 

(A9) 

the 

(A10) 
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X 


t 

1 i = k gi^qCt) -7 gi(°)qC°) e T 



iii , 

gjCOqCOe T dK-\ / 


dgl 

dT 


ill 

q(5)e T d£ 


(All) 

The first integral is seen to be the same as in equation (Al) with 
replacing g Q , and likewise for the second integral, with the derivative of 
g-L replacing g . Then the first transformation of the first derivative term 
is 0 


CT iq -T 2 q) + T ^ (T 2 q-T 3 q) . . . - ± gl (0)q (0) e~ t/x 


The second transformation of the first derivative term is 


i 1 = ! 

2 T 


ill 

,1 T 

Ij e d£ 


(A12) 


(A13) 


which can also be expressed in terms of lower order transformations to obtain 

t 


l 2 = 7 giCt)(T iq -T 2 q) -2^i C T 2 q_T 3 q) + 3T0- 1 (T 3 q-T 4 q)... -± gl (0)q(0) (fj e T 


d 2 gi 


and, in general. 


(A14) 



(i+j-l) * _i-i 
i.'Cj-l)! 


dl gj 

dt 1 


[ T i + j_iq- T i+j q] 


t 1 g i (0)q(0) 



(A15) 


The same integration pattern holds for the transformation of all higher 
derivative terms in equation (2) , thus leading to the general term given by 
equation (5) . 


The numerical coefficients (i+j-l) !/i! (j-1) ! in equation (5) will be 
recognized as the values along the jth diagonal of Pascal's triangle, and 
the coefficients k!/2!(k-Z)! will be recognized as the values along the kth 
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Sketch ( j ) 


row. This is a simple but effective 
aid to writing the transformed system 
equations and is illustrated in 
sketch (j). 

The transformation term f(t) in 
equation (5) generated by the initial 
conditions will not be developed in 
general. It is composed of initial 
values of the state variables and the 
parameters, and initial derivatives of 
both, up to and including the (k-l)th 
derivative, and decays to zero due to 
the exponential term as shown in 
equation (A15) . 
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NONDIMENSIONAL TIME, t/r, FOR 
PARAMETER CONVERGENCE 
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- Time for parameter convergence; output error formulation. 


33 


I 




(a) Step variation. 

Figure 2.- Estimation of time variable parameters; first-order system. 
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(b) Ramp variation. 
Figure 2.- Continued. 
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(c) Sinusoidal variation. 
Figure 2.- Concluded. 
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Figure 3. 
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(a) Step variation. 


Estimation of time variable parameters; second-order system. 
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(b) Ramp variation. 
Figure 3.- Continued. 
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(c) Sinusoidal variation. 
Figure 3.- Concluded. 
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Figure 4 . - Effect of number of error components on the estimation of 
sinusoidally varying parameters; second-order system, cop = 1. 
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Figure 5.- Effect of number of varying parameters on the accuracy of 
estimation; second-order system, ux. = 1. 
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Figure 6 
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- Effect of adjustment gain on the accuracy of parameter estimation; 
second-order system, cop = 1. 
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SYSTEM PARAMETER 
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Figure 7.- Estimation of time variable parameters by digital mechanization of 
the equation error formulation; second-order system. 
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Figure 8 
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